The quadrupolar phases of the S — 1 bilinear— biquadratic Heisenberg model on the 

triangular lattice 
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Using mean-field theory, exact diagonalizations and SU(3) flavour theory, we have precisely 
mapped out the phase diagram of the S — 1 bilinear-biquadratic Heisenberg model on the tri- 
angular lattice in a magnetic field, with emphasis on the quadrupolar phases and their excitations. 
In particular, we show that ferroquadrupolar order can coexist with short-range helical magnetic 
order, and that the antiferroquadrupolar phase is characterized by a remarkable 2/3 magnetization 
plateau, in which one site per triangle retains quadrupolar order while the other two are polarized 
along the field. Implications for actual 5 = 1 magnets are discussed. 

PACS numbers: 75.10.-b, 75.10.Jm 
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When discussing quantum magnets, it is useful to clas- 
sify models according to whether or not the ground state 
breaks the 577(2) symmetry. While simple examples of 
both cases are well known (long-range magnetic order 
for broken SU(2) symmetry, spin ladders for non-broken 
SU(2) symmetry), a lot of activity is currently devoted 
to the problem of identifying more exotic ground states 
of either type. In the context of non-broken SU(2) sym- 
metry, the attention is currently focused on the search 
for Resonating Valence Bond ground states in frustrated 
quantum magnets (for a review see 

Regarding SU(2) broken ground states, the existence 
of nematic order [2| is well documented in a number of 
models, but its identification is faced with two difficul- 
ties: First of all, these models usually require four-spin 
exchange |3J or biquadratic spin interactions that are 
rather large for Mott insulators [5j- Besides, nematic or- 
der does not give rise to magnetic Bragg peaks, and there 
is a need for simple criteria that could help identifying 
nematic order experimentally. 

In that respect, the recent investigation of NiGa2S4 
and the subsequent proposal by Tsunetsugu and Arikawa 
that some kind of antiferroquadrupolar (AFQ) order 
might be at the origin of the anomalous properties of that 
system, are very stimulating. They have investigated the 
AFQ phase of the 5=1 Heisenberg model with bilin- 
ear and biquadratic exchange on the triangular lattice, 
defined by the Hamiltonian: 



H = [cos i? S, 

(id) 



Sj + sin-i? (S» • Sj) 2 ] -h^S, 



(1) 

Using a bosonic description of the excitations, they have 
investigated the zero-field case and shown in particular 
that: 1) The magnetic structure factor has a maximum 
but no Bragg peak; 2) The susceptibility does not vanish 
at zero temperature; 3) The specific heat has the charac- 
teristic T 2 behaviour of 2D systems with broken SU(2) 



symmetry. These features agree qualitatively with the 
properties of NiGa2S4, but several points remain to be 
addressed. In particular, unlike the AFQ phase of the 
Heisenberg model studied in Ref.0, the short-range mag- 
netic fluctuations are incommensurate in NiGa2S4. So 
the actual magnetic model describing NiGa2S4 remains 
to be worked out. Maybe more importantly, a more di- 
rect identification of quadrupolar order as being at the 
origin of its properties would be welcome. 

In the present paper, we address these points in the 
context of a thorough investigation of the 5=1 bilinear- 
biquadratic Heisenberg model on the triangular lattice, 
Eq. We put special emphasis on the quadrupolar 

phases and on the effect of a magnetic field. 

Quadrupolar operators and states: To discuss 
quadrupolar (QP) order, it is useful to introduce 
the QP operator Q 4 of components (5f) 2 - (Sf) 2 , 
(2(5f) 2 -(5f)M5?) 2 )/V3, SfSf + SfSf, SfS^ + S^Sf, 
and SfSf + SfSf. In the finite Hilbert space of 5 = 1, 
the biquadratic term can also be expressed by quadrupo- 
lar operators, and the Hamiltonian can be rewritten as 



H 



E 

(id) 



J\ — t-\ Si • S 



2 Qi ■ Qj 



(2) 



with Ji = Jcosi? and Ji = Jsinz?. Since Qi ■ Qj + Sj • 
Sj = —2Vi,j — 2/3, and since the permutation operator 
Vij has SU(3) symmetry for spin 1, the Hamiltonian is 
5£/(3) symmetric for J x = J 2 (i9 = tt/4 and -3vr/4). It 
turns out to be convenient to choose the following time- 
reversal invariant basis of the SU (3) fundamental repre- 
sentation: 



V2 



\y) = 



ID 



l 



V2 



\z) = -i\0). (3) 



Quadupolar spin-states are then defined as linear com- 
binations with real amplitudes d v (such that |d| = 1) 



2 



|Q(d)) = d x \x) +d y \y) + d z \z) 



(4) 



| (2(d)) is time-reversal invariant, which implies that 
(<2(d)|S|Q(d)) = 0, and it is a zero eigenvalue eigen- 
state of the operator (d • S) 2 . It describes a state where 
the spin fluctuates mostly in the directions perpendic- 
ular to the vector d, referred to as the director, which 
nicely illustrates the very heart of a spin nematic state: it 
has no magnetic moment, but nevertheless breaks SU(2) 
symmetry due to the presence of anisotropic spin fluctu- 
ations. 

Zero- field phase diagram: First, we construct the 
variational (mean-field) phase diagram in the variational 
sub-space of site-factorized wave functions of the form 
Y\j \Q(dj)), allowing complex dj's ||, and assuming 3- 
sublattice long-range order. Without magnetic field, we 
get four phases (Fig. [I}. Adjacent to the usual ferromag- 
netic (FM) phase, which is stabilized for tt/2 < d < 57r/4, 
we find two QP phases. The expectation value of Q; • Qj 
in the site-factorized wave function subspace is 



(Qi • Qi) = 2|di • dj\ 2 - 2/3; i + j 



(5) 



Since it induces a negative QP exchange, a negative bi- 
quadratic exchange tends to drive the directors collinear, 
leading to a stabilization of the ferroquadrupolar (FQ) 
state for -3tt/4 < d < ®f F with 9f F = arctan(-2) « 
— 0.357T. On the other hand, a positive biquadratic term 
induces a positive QP exchange, which is minimized with 
mutually perpendicular directors. On the triangular lat- 
tice, this is not frustrating since all bonds can be sat- 
isfied simultaneously by adopting a 3-sublattice config- 
uration with e.g. directors pointing in the x, y and z 
directions respectively, a phase that can be called an- 
tiferroquadrupolar (AFQ). This is realized between the 
SU(3) point and the FM phase (tt/4 < <d < tt/2). 




FIG. 1: (color online) (a) Zero-field phase diagram. The in- 
ner circle is the variational result, the outer circle the exact- 
diagonalization one. The magnetic phases are shaded in gray, 
(b) Probabilities of spin fluctuations | {^(n) IV 1 ) | 2 in the pure 
state %j) = \y) (left) and in a state with finite magnetization 
(right). jS'(n)) is the coherent spin state pointing in direction 



For Q^ IF < < 7r/4, we get the standard 3-sublattice 
120°-antiferromagnetic (AFM) phase, but with a pecu- 
liarity: the spin length depends on J%l J\. It is maxi- 
mal (|(S)| = 1) for J 2 = and vanishes continuously 
as \(S)\ cx y/2Ji — | J2I at the FQ boundary, where the 
trial wave function becomes a QP state with the direc- 
tor perpendicular to the plane of the spins. Approaching 
the SU(3) point, |(S)| — > v8/3, and the wave functions 
on the three sublattices become orthogonal. Actually, at 
this highly symmetric point any orthogonal set of wave 
functions is a good variational ground state. It includes 
the AFQ state as well, which is connected to the AFM 
state by a global 5(7(3) rotation. 

Next, we have performed finite-size exact diagonal- 
ization calculations on samples with up to 21 sites. In 
Fig. |3 we show the size dependence of the correlation 
functions associated with the FQ, AFM and AFQ or- 
der. More specifically we determine the structure fac- 
tors ^exp[ik • Tj](Co ■ Cj), where Cj stands for the 
spin or quadrupolar operator at site j and k is the T 
or K point in the Brillouin-zone for the ferro or anti- 
ferro phases, respectively. As can be clearly seen, the 
5(7(3) point separates the AFM and AFQ phases, and 
the d dependence of the structure factors in the AFQ 
range is reminiscent of that reported in the ID model |9( . 
The phase boundary between the FQ and AFM phases 
is, on the other hand, strongly renormalized from the 
mean-field value 0* /F ~ — 0.357T to about O c w — 0.117T 
(J 2 « -0.4 J x ) E3. We have also verified the presence of 
the appropriate Anderson towers of states in the energy 
spectrum for the FQ, AFM, 5(7(3) AF, and AFQ phase 
|ll|. Let us emphasize that we found no indication of 
disordered or liquid phases in that model. 

Quadrupole waves: Since the usual spin-wave the- 
ory is not adequate to describe the excitations of QP 
phases, we use the flavour- wave theory of We as- 



Antiferromagnetic (K point) 
-- Ferroquadrupolar (r point) 
■-■ Antiferroquadrupolar (K point) 
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FIG. 2: (color online) Spin and quadrupolar structure factors 
at the F and K points for different finite clusters. The system 
sizes are labeled by the symbol type. 
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FIG. 3: Spin correlation function S(k, uj) from flavor-wave 
calculation for d = -3tt/4, -5tt/8, -it/2, -3tt/8, and 9f F 
from top to bottom (shifted by J) in the FQ phase. The 
dispersion u>(q) is the solid curve, the matrix element is the 
dashed line measured from the solid line. Left upper corner: 
the Brillouin zone. 

sociate 3 Schwinger-bosons a„ to the states of Eq. © 
and enlarge the fundamental representation on a site to 
a fully symmetric SU (3) Young-diagram consisting of 
an M box long row. The spin operators are expressed 
as S a (j) — — «e Q , / 3 7 a| j (j)a 7 (j). Condensing the bosons 
associated with the ordering then leads to a Holstein- 
Primakoff transformation. This approach is equivalent 
to the bosonic description of the AFQ phase in |7j , so we 
will concentrate on FQ phase. To describe a state with all 
directors pointing in the y direction, we let the y bosons 
condense and replace aj, and a y by (M — a x a x — a\a z ) 1 / 2 . 
A 1/M expansion up to quadratic order in the Holstein- 
Primakoff bosons a x and a z followed by a standard Bo- 
goliubov transformation leads to: 

H=Y J E^ k ) K(kK(k) + 1/2] , (6) 

withw„(k) = y/Al(k)-B*(k), A„(k) = 3(Ji7(k)-J 2 ), 
B„(k) = 3(J 2 - Jib(k), and 7 (k) = £ r exp(zr • k)/6, 
where r spans the 6 neighbours of a site. We get two 
branches of quadrupole waves associated to a x and a z . 
In zero field, they are degenerate throughout the entire 
Brillouin zone. 

The imaginary part of the spin-spin correlation func- 
tion (shown in Fig. |3J) is given by: 

QXX( , x MV+B z (k) ^ 

S (k,w) = -— 8{w - w s (k)) . (7) 

Ul z {i<.) 

The v = z branch contributes to S xx (k, u>) - the spin 
fluctuations are perpendicular to both the director y and 
the direction of the QP excitation z. Correspondingly, 
the v — x branch contributes to S zz (k 1 u>), which is equal 
to S xx (k,u). S vy (k,u>) = (it appears in higher order 
in 1/M). Close to the T point, both the dispersion of 
the flavor-wave and the correlation function are linear 
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FIG. 4: (color online) Magnetic phase diagram. Solid 
(dashed) lines denote 1st (2nd) order phase boundaries in 
the variational approach. The dotted line shows the exact 
boundary of the FQ phase (two magnon bound state forma- 
tion, see Ref.|Tll|1. Along the dashed-dotted lines the varia- 
tional solution is highly degenerate. The plateaux are shaded 
in gray. Filled arrows represent fully polarized magnetic mo- 
ments, empty arrows partially polarized ones. 

in k: u>„(k) = vk and S^k) = S zz (k) — x^fc, where 
X = l/[6(Ji — J2)] is the mean-field susceptibility and 
v = y9^2v^2 — ^i)/2- As we approach the boundary 
to the AFM phase, Lo v (k) softens and the spin struc- 
ture factor diverges at the K point of the Brillouin zone 
as Sik) ex £(1 + £ 2 |k — k/<-| 2 ) -1 / 2 , where the correlation 
length £ = 1/ ^/10(6^ /F — 1?) is associated with the short 
range easy-plane 120° AFM order. So FQ order can co- 
exist with non-ferromagnetic short-range correlations, a 
result to keep in mind when comparing with experiments. 

Finite magnetic field: In this case, the variational 
phase diagram is surprisingly rich, as shown in Fig. 0] 

For < < 7r/4, the 3-sublattice AFM order gives 
rise to the chiral umbrella configuration up to full po- 
larization. However, for negative J2, a m = 1/3 plateau 
occurs with up-up-down configuration, reminiscent of the 
plateau reported for the S = 1/2 case [ijj. Interestingly 
enough, this magnetic configuration is also realized below 
the plateau close to the FQ phase. Above the plateau, 
the spin configuration is coplanar (see Fig. HJ. 

In the FQ phase, the directors turn perpendicular to 
the magnetic field [8|, and the QP state is given by: 

\ipj) = cos^\Q(d x ,d v ,0)) + ism^\Q(-d v ,d x ,Q)) . (8) 

It develops a magnetic moment m — (S z ) = sin fi parallel 
to the magnetic field by shifting the center of the fluctu- 
ations [c.f. Fig.[Hb)] . The magnetization grows linearly 
with the magnetic field as m — h/[6(Ji — J2)]. One of 
the two degenerate gapless modes acquires a gap propor- 
tional to the field, while the other one remains gapless - 
it is the Goldstone mode associated with the rotation of 
the director in the xy plane fTl| . 

The most surprising feature of the phase diagram is the 
magnetization plateau at m = 2/3 that occurs starting 
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from the AFQ phase (tt/4 < $ < n/2) Q. This plateau 
is of mixed character: It is a 1 1 10) state, where |1) is 
magnetic and |0) QP. It is stable between h — 3Ji and 
3(4 Ji — 3J 2 + \/9J% — 8Ji J 2 )/2 according to the varia- 
tional calculation, a result confirmed by exact diagonal- 
izations of the magnetization for systems with up to 27 
sites: There is indeed clear evidence of a plateau at 2/3, 
and the overall magnetization curve is in good agreement 
with the mean-field result, as shown in Fig. El Note that 
the occurrence of a plateau at 2/3 without a plateau at 
1/3 is truly remarkable. Indeed, this is very unlikely to 
occur for purely magnetic states since the 2/3 plateau 
would correspond to a higher commensurability (5 up, 1 
down in the simplest scenario) than the 1/3 one. This 
plateau can be considered as a characteristic of AFQ or- 
der. Below the m = 2/3 plateau, for ir/4 < i) < ir/2 and 
h < 3cos$ the variational ground state is the deformed 
QP state of Eq. (|SJ), with two perpendicular directors in 
the xy plane, while on the third sublattice the QP state 
is |0). The magnetization is given by m — 2h/(9Ji). 

Discussion: Let us put these results in experimental 
perspective. The occurrence of FQ order for negative 
biquadratic exchange makes it a more likely candidate 
a priori. Indeed, a mechanism based on orbital quasi- 
degeneracy has been shown to naturally lead to a nega- 
tive biquadratic coupling |l5l |. In contrast, mechanisms 
leading to a large positive biquadratic coupling remain 
to be found. Otherwise, the FQ and AFQ have a lot 
in common, in particular gapless modes, maxima but no 
Bragg peaks in the magnetic structure factor, a T 2 spe- 
cific heat and a linear magnetization at low field. Let us 
emphasize that the location of the maxima depends pri- 
marily on the bilinear exchange (sign, topology, range,...) 




FIG. 5: (color online) Magnetization curves obtained by exact 
diagonalization for •& = 37r/8, where the presence of a plateau 
at m = 2/3 is confirmed. The inset shows a magnetization 
curve at the Heisenberg point with a small plateau stabilized 
at m — 1/3. 



and is not directly related to that of the gapless modes, 
which depends on the type of QP order, hence on the sign 
of the biquadratic exchange. The main difference is the 
presence of a remarkable magnetization m = 2/3 plateau 
in the AFQ phase. In addition, the removal of one of 
the gapless modes of the FQ state in a field should be 
visible in the low temperature specific heat. Regarding 
NiGa2S4, it will be interesting to include further neigh- 
bor bilinear interactions into the present model to see if 
a QP phase with dominant incommensurate fluctuations 
can be stabilized. The properties of the corresponding 
phase are expected to depend strongly on the sign of the 
biquadratic coupling, and the results of the present paper 
should help in identifying such a phase. 
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